The Annals of Applied Probability 

2005, Vol. 15, No. IB, 587-614 

DOI: 10.1214/105051604000000657 

© Institute of Mathematical Statistics. 2005 



MODERATE DEVIATIONS FOR PARTICLE FILTERING 

By R. Douc, A. Guillin and J. Najim 

Ecole Poly technique, Universite Paris Dauphine and Ecole Nationale 
Superieure des Telecommunications 

Consider the state space model (Xt,Yt), where (Xt) is a Markov 
chain, and (Yt) are the observations. In order to solve the so-called 
filtering problem, one has to compute C(Xt\Y\, . . . ,Yt), the law of 
X t given the observations (Yi, . . . ,Y t ). The particle filtering method 
gives an approximation of the law C{Xt\Y\, . . . , Yt) by an empirical 
measure i Y_\ S Xi t ■ In this paper we establish the moderate devi- 
ation principle for the empirical mean i VJ™ ip(xi,t) (centered and 
properly rescaled) when the number of particles grows to infinity, en- 
hancing the central limit theorem. Several extensions and examples 
are also studied. 



1. Introduction. 

The state space model. Let (Xt) be a Revalued sequence of unobserved 
random variables and let (Yt) be the M m -valued observations, t > 1. 
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We endow K (resp. 


R m ) 


with its Borel 


er-field 


B(R d ) [resp. B 


(R m )} and we 



assume that (Xt)teN is a Markov chain with initial distribution P(Xo E A) 
J A ao(x)fi(dx) and transition kernels 



F(X t e A\X t -i = x t -x) = / at(xt-i,x t )dfj,(xt), 

J A 



t > 1, 



where /i is a reference measure on M. d and do (resp. at) is a probability 
density (resp. probability kernel density) with respect to /i. 
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The observations (Yj) are R m -valued and independent conditionally on (Xt) 
Formally, Yt depends on Xt via the kernel 

F(Y t £ B\X t = x t )= [ h(x t ,yt) du(y t ), t > 1, 
Jb 

where v is a reference measure on R m and bt is a probability density kernel 
with respect to v. It is worth noting that the general process (Xt,Yt) is a 
Markov chain. 

These models, either called state space models or hidden Markov mod- 
els (HMM), are widely used in engineering, biology, mathematical finance, 
geophysics, and so on. For an overview, see [18] and the references therein. 

We will denote by y\ the R m -valued series of observations (y s ,...,y t ) 
and when s < t, by ft\ s (xt\yf) [or simply ft\ s (xt)], the conditional density 
of Xt given Yf = yf with respect to [i. In the case where s = t, f t \t is the 
filter density; in the case where s = t — 1, ft\t-i is the one-step predictor. 
These quantities are related via the following relations: the propagation (or 
prediction) step, 



(1-1) ft\t-i{xt\y\ l )= J ft-i\t-i{x\y\ 1 )a t (x,x t )dfi(x), 

and the updating step, 

M n , , f , t \ ft\t-i{xt\y\~ l )bt{x t ,yt) 

(1-2) ft\t{xt\yi ■ 



f ft\t-i(x\yi )bt{x,y t )ii(dx) 

Particle filtering. The recursive computation of the filter density is a 
major issue. However, apart the very important Gaussian case for which fil- 
ter density can be computed recursively with the Kalman-Bucy equations, 
there is no hope to get a closed-form formula for the filter density f t \t in 
the general case. Among the body of methods available to approximate the 
filter density (e.g., extended Kalman filter, approximate grid based filters, 
etc.), particle filtering (also known as recursive or sequential Monte Carlo 
filtering) has recently received a lot of attention. Let us mention the impor- 
tant contribution of Del Moral et al. [4, 5, 6, 7, 12] and the work of Kiinsch 
[18, 19]. The book edited by Doucet, de Freitas and Gordon [17] gives an 
overview of the subject and provides extra references. 

In the sequel, we will say that [x\, . . . ,xn) is a sample from f dfj, if (xf, 1 < 
i < N) are independent and identically distributed (i.i.d.) with probability 
distribution f dfj,. We define recursively the approximate filter density: 

At time t = 0, (x^o; 1 < i < N) is a sample from ao dfj, and 

jn / s = h (g; yi )( 1 / N ) Sili Q i {xi,o, x) 

1,1 Indh(x,y 1 )(l/N)Yl^L 1 ai(xi t o,x)fi(dx) 
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At time t = T, (x^t; 1 < i < N) is a sample from f^ T d\x and 

f N i \_ b T +i{x,y T+1 ){l/N)J2fLiaT+i(xi,T,x) 
JT+l\T+l\ x ) 



T+1|T+1 lRdb T+ i{x,yT+i)(l/N)J2f=iaT+i(xi,T,x)n(dx) 

As the number of particles N grows to infinity, the empirical probability dis- 
tribution jjJ2i ^x iT converges to the filter probability distribution f T \ T d\i. 
Among the main results for the particle filter, let us mention the law of 
large numbers [12], central limit theorems ([7, 9, 11], see also [19] for a nice 
exposition) and the large deviation principle [6]. 

Links with genetic algorithms. The approximate particle filter as ex- 
pressed in the Introduction, 



bT(x,yT){l/N)J2iLiaT(x it T~i,x) 
R d b T {x, y T ){l/N) J2?=i a T (x iiT -i,x)fi(dx) ' 



/t|t( x ) 



can be interpreted as a genetic algorithm, a particle system approximation 
of the Feynman-Kac formula, as well as a so-called bootstrap filter in the 
filtering literature. This is of importance since up to some compatibility 
with the assumptions, we will then be able to rely on the important body 
of methods developed in the framework of particle systems approximation 
of the Feynman-Kac formulae (see [4, 6, 7, 8, 9, 10, 11, 12, 13]). Denote by 



(1.3) b T (x T -i) = I b T (x,yT)a T (xT-i,x)iJ,(dx) 

and 



(1.4) clt(xt-i,xt) 
In this case, f^ T writes 



br (xt ,yr)aT pgr- i,x T ) 
b T (xT,yT)aT(xT-i,x T )fJ-(dx T ) ' 



N 



f N i \ b T (x iT ^ 1 ) „ 
/t|tW = Lu T^N i , -a T (xi tT -i,x) 

i=l 22k=lbT{Xk,T-l) 

and one can see the propagation and updating steps as a selection step 
followed by a mutation step: 

(x l , T ,l<i<N) sel -^ on (x itT ,l<i<N) 

mutation / , . . . , n 

> {x it T+i,l<i<N). 

The selection step consists in drawing a multinomial Ai(uj\ y T, ■ ■ ■ , ^n,t), 
where u>iT = „^ T ^' ,T ~ 1 ^ — to choose accordingly the new particles (xi t, 1 < 

i < N) among the generation (xi t T, 1 < i < N). At generation T + 1, each par- 
ticle Xi^+i is drawn independently according to the distribution dr(ij,r, •) dfi. 
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The main results. In this paper we establish a moderate deviation princi- 
ple (MDP) for the particle filter at time T conditionally on the observations 
(yi, . . . , Ut)- Since the observations (yt) are frozen, this is a quenched re- 
sult and we might sometimes drop the observations (yt) in our notation. 
In the sequel we will, therefore, denote by Pt the conditional probability 
F(-\Y 1 =y l ,...,Y T = y T ). 

The MDP complements the previously obtained CLTs [7, 9, 11, 19] and 
LDP [6] and is established for the rescaled and centered quantity 

M% = — (i>o(xifl) -J tpoaod/J,, ...,ih{xi )T ) -J ipT h\T , 

where the functions (ipo, . . . , ipx) are bounded and the speed b 2 N is such that 

lim bhi = lim ^/NbTr 1 = oo. 

The formal definition of an MDP states that there exists a good rate function 
It such that 

1 



int(r) ± ~N^oo b 2 



- inf I T < liminf At- logP T {M^ G T} 
< lim sup -=- logP T {M^ E T} 

N— >oo b N 



N 

T 



< — inf It- 

r 

The set T C M T+1 is Borel, with interior int(r) and closure T. The rate 
function It depends on the asymptotic covariance matrix 

s,KT' 

which appears in the central limit theorem (see details in Section 3.1). For 
applications of moderate deviations, see [1] or [14]. 

We then develop various extensions, such as the MDP for unbounded 
functions and a functional MDP for the particle density profile, 

1 [Nu] 

u i ^ t= (4>(xi,T) ~ m T {ip))- 



b N VN ^ 

In this situation, the rate function turns out to be given by 

T m _ f 1 f 2 W * | fO) ( i L\ 

JtU) -Jo 2a T W 2 \VtM 4W/ 

where / is absolutely continuous with /(0) =0. The last part of the article 
is devoted to examples such as nonlinear observation models with additive 
noise and stochastic volatility models. 
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The paper is organized as follows. In Section 2 we give the notation and 
we state the main assumptions. In Section 3 we establish the MDP. Section 
4 is devoted to various extensions of the MDP. Examples are studied in 
Section 5. 



2. Notation, assumptions and a preliminary estimate. 



2.1. Notation and the main assumption. We will endow R d (resp. W 71 ) 
with its Borel a-fleld B(R d ) [resp. B(R m )]. Let H be a reference measure 
on (M d , B(M. d )) and denote by L l (ix) the set of /i-integrable functions. Sim- 
ilarly, consider the reference measure v defined on (M m ,B(M m )) and the 
function space L l (v). We will simply write B and L 1 whenever the con- 
text is clear. As usual, || • ||i denotes the L 1 -norm and || • ||oo the sup- norm 
(ll/lloo = sup x 1/0)1). Recall that 

F(X t G A\X t -i = x t -i) = I at(x t -i,x t )dfi(xt) and 

J A 

F(Y t £B\X t =x t )= [ b t {x u y t )dv(y t ). 
JB 

In the following, the sequence (&jv)at>i will denote a sequence of nonnegative 
real numbers with the property that 



JN 

lim 6j\r = lim — — = oo. 
We shall use the following notation (by convention / |o = «o) : 

(2.1) mt(tp) = J tpf t \tdfJ. and m N>t (tp) = J ' ipf* t d[i, 

(2.2) L t ip(x) = / a t {x,u)b t (u,yt)ip(u)n(du), 



1 N 

(2.3) M N W = —j= E W>Kt) " mtW) 



where 



(2.4) 



1 



QnW = -, Ttf J2 (^( x i,t) ~ m N,t(tp)) and 

b N VN ^[ 



RnW = -r~ ( m N,M) ~ m M))- 
on 
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We might sometimes drop ip and simply write Q l N and R N . Denote by 

M^o, . . . , Vt) = M^(^o: t) = (M° N (i>o),. ■ -,M^ T )) e R T+1 , 

X T = (X ,...,X T )eR T+1 . 

Recall that P T = P(-|Yi = yi, ■ ■ ■ ,Y T = y T ). We will denote by E T the expec- 
tation with respect to Ft- Let us introduce now the main assumption on 
the model. 

Assumption A-0. For every t > 1, 

7t = supL t l(x) = sup / at(x,u)b t (u,yt)n(du) < oo and 

L t l(x)>0 Vi£R d . 

Remark 2.1. Since Lil(x) > under Assumption A-0, it is straightfor- 
ward that 



(2.5) Kt — J Ltl(x)f t -i\t-i{x)ii(dx)>0. 

However, Assumption A-0 does not imply inf x bt(x,yt) > as will be illus- 
trated in the stochastic volatility model (see Section 5) where inf^ bt(x, yt) = 
0. 

Remark 2.2. A stronger version of Assumption A-0 is used in Section 4. 
See also Remark 4.1 for the link with genetic models. 

Following [19], we define recursively the following variance-like quantities: 

°t (VO = J - rn t {ip)f 'f t \ t dfi and 

(2.6) 

(2.7) V t (ij) = aU^) + ^V t - 1 (L t 4,-m t (i>)L t t), V ty) = o^ty), 

K t 

and the related covariance-like quantities: 

1 

(2.8) V r ^r,^t) = —V r ,t-i{i l r,L t (ii t -m t (ii t ))) forr<£, 

(2.9) v t , t (ik,<lH) = \{v t {ipt + 4>t) - Vt(ip t ) - v t {4>t))- 

Of course, V r t(ipr,ipt) = Vt r (tpt,ipr)- The covariance matrix is then defined 
by 

In the sequel, we will use (•, •) for the scalar product and "■" for the matrix 
product. 
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2.2. An exponential estimate. In this section we prove an exponential 
estimate which will be useful to prove the MDP. This result is very close to 
Theorem 3.1 in [10] (see also Lemma 4 in [11] and Theorem 3.39 in [12]). 
However, since the model is slightly different, we provide a full proof. 

Lemma 2.1. Assume that Assumption A-0 holds. Assume, moreover, 
that ip : R d -> R is a bounded measurable function. Then, for every e > 0, 
there exist a{T) > and (3(T) > such that 



(2.10) F q 



(2.11) P T 

Moreover, one can define recursively 
a(0)=2. 



>ej <a(T)e-^/^M»>. 
0(0) =2, 



a(T) =4max(l,a(T- 1)), 



and 



P(T) = max 8, 



16/?(T - 1) 7 | 



Proof. We shall prove (2.10) by induction. Recall that "ft is defined in 
Assumption A-0 and that Kt is defined in (2.5). At time t = 0, the result is 
a direct application of Hoeffding's inequality. Assume that (2.10) holds at 
time t = T — 1 and write 

. N N 

— ^{xi,t) ~ mr(ip) = E ^( x i,T) ~ m N:T (ip) + m N:T (ip) - m T (ip). 



N . 
i=i 

Thus, 



i=l 



N 



^E^M -m T (tp) 



1=1 



> £ 



<F T \ 



N 



N 



i=i 



> 



+ P T (jm7v,T(V0 -mr(^)| > 0. 



Denote by .Fjy the cr-field generated by (xj ; t;0 <i < N, <t <T). Condi- 
tionally on Fjf 1 , the variables (x^t) are i.i.d. Therefore, Hoeffding's in- 
equality yields 



P T 



1 N 

— J2ifj(x iiT ) - m N)T (ip) 

i=l 



> 



J=l I <2exp 



Ne 
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which implies 



(2.12) P T | 



N 



N 



i=l 



> - I <2exp 



iVe 2 



Let us now deal with mN,T{' l P) — mr(ip)- Apply the following identity: ^ 

m N>T {ip) -m T (Y>) 

_ (1/AQ Ejli LtM^t) I L T il>f T -i\T-i d» 
{I /N) E-Ii ^t1(^,t) / ^rl/r-i|r-i ^ 

A? 



1 



J L t 1/t-i|t-i d/i 

) L T tf T -i\T-idl-i \Nfr[ J 1 



Therefore, 



< 



+ 



\ 1 N f 

S -jy22 L Tip(xi,T)-j Lri)f T -i\T-idfi 

(. i=l 

f 1 N f 

M — X)Lrl(^,r)- / Lrlf T -i\T-idn 

(. i=l 



> 



As H-LtV'IIoo — TtII^IIoo' t ne induction assumption yields 
Pt( \mN.T(ip) -m T (ip)\ > £ 



(2.13) 



< a(T — 1) exp 
+ a(T — 1) exp 

< 2a(T - 1) exp 



Nk 2 t e 2 



16/3^-1)11^1^ 
N K 2 T e 2 



16/3(T-1)||L T 1||2 



ooll VIlOO 



NK 2 T £ 2 



16/3(T - 1) 7 ^ 



Inequality (2.10) is proved with the help of (2.12) and (2.13). Finally, (2.13) 
yields immediately (2.11). □ 
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3. The moderate deviation principle. 

3.1. The MDP. The moderate deviation principle is first proved for 
bounded test functions ipo,... ,ipr- The proof is simpler and one can focus 
on the main idea which is an induction approach. This technique has been 
used by Del Moral and Guionnet [6] for the LDP of the particle filter and by 
Kiinsch [19] for the CLT. The induction enables us to split M^(^o> • • • , Vt) 
into one quantity depending on the last generation of particles (xi : T)i<i<N 
and another one depending on all the other particles. These quantities turn 
out to be asymptotically independent. We relax the boundedness assumption 
over the test functions in Section 4.1. 

Theorem 3.1. Assume that Assumption A-0 holds and let ipo, . . . , ipT 
be bounded measurable functions. The function defined by 

It(xt) = sup <^(xt,At) - > 

\ T m T+1 !> 1 > 

is a good rate function and the family of random variables (M^(-0o: t))n>i 
satisfies the moderate deviation principle with speed b 2 N and good rate func- 
tion It, that is, 

- inf I T <liminf-J-logPT{M^(-0o:T) GT} 

int(r) N-^oo b N 

< limsup-2-logP T {M^(V>o:T) GT} < - inf I T , 

AT-kx> o N r 

forT £B(R T+1 ). 

Remark 3.1. If the covariance matrix Vt(V>0:t) is invertible, then the 
rate function can be expressed as 

T / \ (x^V^^oit) -x t ) 
1t(x t J = • 

Remark 3.2 (Particle profile). In the case where all the functions but 
tpT are equal to zero, M^(-0o : r) reduces to the particle profile M^(^t) and 
the rate function is given by the usual formula: 

lT{x) = 2v^hY 

Moreover, one can prove under additional assumptions that the asymptotic 
variance Vt(^t) is uniformly bounded in time: 

(3.1) W)<#IM& foralH>l. 
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This result is based on the property that the filter distribution forgets its 
initial condition (see [8], Theorem 3.1 and [13], Section 4.2.3 for the contin- 
uous time model). Equation (3.1) gives an MDP upper bound which does 
not depend on time. 

Remark 3.3 (Splitting the covariance matrix). Consider the covariance 
matrix Vt(*Po-.t)- Denote by 

pT-i{x) = (Xr-iih-i + —L T (ipT - m T (4>T)))(x) 
\ kt J 

and let \t-\ = (Ao, • • • , Ay_2, 1). Then the following identity holds true using 
(2.6)-(2.9): 



(Ar-l, Vt_i(^0:T-2)/>T-i) • At-i) 

(3.2) 

= (A T , V t (^o:t) • A T ) - X T a T (i/j T )- 
This identity will be useful in the sequel. 



3.2. Proof of Theorem 3.1. We will proceed by induction. Let uq be a 
bounded function, then M^(uo) satisfies the MDP with good rate function 

2 

1q(x) = 2Vo(u ) s i nce the particles (sc^o) are i.i.d. with distribution aodp. 
Assume that at time T — 1, for every bounded functions uo, ■ ■ ■ , ut-i, the 
random variables (M^- _1 (uo: t-i))n>o satisfy the MDP in M T with good 
rate function It-i- Consider now bounded functions ipo,...,ipT and the 
family of random variables (NlJj(ipo- t))n>i- The following lemma is crucial: 

LEMMA 3.2. Recall that by the definition of f^\ T and by (2.4), 
Rjj = ~T~~~ { m N,T (V'T') - m T (lp T )) 

b N 



6 « V E,"iirl(ii,T-i) 



and let 



1 / N N \ 

R N = 1 7tt — Yl L T il; T (xi ; T-i) ~ m T (^T) Y] L T t(x iyT -i) , 

b N VNK T \ i=l i=l J 

where Kt is defined in (2.5). Then the random variables PJ^ and Rjj are 
exponentially equivalent up to the speed bj^. Otherwise stated, 

limsup-^-logPT{|-R^ - Rn\ > 5} = -co for all 5>0. 
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Proof of Lemma 3.2 is postponed to Appendix A. It is an alternative to 
the delta-method used for the CLT in [19]. 

Proof of Theorem 3.1 (Continued). The random variables Mjj = 
Qjj + Rjf and Mjy = Qjj + Rjj are exponentially equivalent by Lemma 3.2. 
Therefore, it is sufficient by Gartner-Ellis' theorem ([14], Theorem 2.3.6) to 
prove that 



T-l 



N 



lim -5- log E T exp { b 2 N V XtM^t) + b 2 N X T Mj;{^T) 



J N L t=o 

(3.3) 

(A T , V t (i/i :t) • A T ) 



By (3.2), 

T-l 



^-logE T ( exp jft^ ^ \ t Mjf(iJ) t ) + b 2 N X T M^i 



t=0 



(A T , V t (^0:t) • At) 



p- log E T I exp | X T b N Q N ^ + — ^— A w 

T-l 1 



i=0 



(At-1, Vt-i('0O:T-2,PT-i) " At- 



2 

where Ajy = &%t(i/>t) — o't(V't)- Recall that J 7 ^ is the cr-field generated by 
(^i,*;0 <i<N, < i < T). In this case, A^v and Rjf are measurable with 
respect to T N . Thus, we get 

^-logE T ^exp + b 2 N X T M T (^ T )^j 



(At, V t (^o:t) • At) 



-2-logE T 

°N 



2 

E T ( exp^A T 6M 



a t^^,t(Vt) 
2 

T-l 



jpT-1 

N 



x exp I ^^A^v + 6^A T ^ + b 2 N ^ A t M^t) 
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(At-1, Vy_i('0o:T-2 ) PT-l) ' ^T-l) 



Conditionally on J- N , the variables (x^t) are i.i.d. Therefore, 
E T exp Xto^Qn - 1 



T-l 

N 



E- 



^exp y -^=- (tp T (xi t T) -m NtT (tp T )) 



\ z T b 2 N a 2 N ^ T ) 
2N 



T-l 



N 



N 



At&tv A 2 b 2 
Et( H 7=-(^t(^i,t) -mjv,T(^r)) ^t-^nt^t) 



N 



2 l2 



+ 



Ai6 



2N 



2N 



{■4>t{x 1)T ) -m NT (ih)) +0 



AT3/2 



T-l 

N 



N 



= (l + E r (0(A^/iV 3 / 2 )|^- 1 )) JV . 

As Vt is bounded, 0(A|6^/A^ 3/2 ) < KX^b 3 N /N 3 / 2 , where if does not de- 
pend on from x^t- Therefore, 



(3.4) 



AT3/2 ; 



V 



< E T (e AT ^ Q ?'" A r^ fT ^^ W ' T)/2 |J^~ 1 ) 



< 1 + 



Let us now deal with 
A 2 6 2 



T"N A 



N 



^{o 2 N M T )-a 2 T m) 



Recall that 

Wn,t(^t) - ot(iPt)\ 

= J i>r (/t|t - fr\T)dn 



J ^tUt\t + /t|t) ^ ( y ^tUt\t - /t|t) 



< 



^tUt\t - h\T)dn 



T 



^tUt\t - h\T)dfi 



As P r {| J>(/$r " /r|r)dMl > 4 < «(T) expC-iVe 2 /^^)^!^)) for every 
bounded measurable ^ by Lemma 2.1, we get 



limsup-2-logE T (|(j 2 Nrjr (V'T) - c4C0t)| > 5) = -oo V<5 > 0. 

TV^oo b N 
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In particular, Rjj and Rjj + (At/2)Atv are exponentially equivalent up to 
the speed b 2 N . We can now conclude 



lim sup 

N-*oo 



-i-logE r exp J b% hM^t) + b 2 N X T M^ T ) 
°n { t =o 

(A T , Vt^oit) • At) 



(a) 



lim sup 

TV— >oo 



Mb 2 



-2-logE T exp 



r-i 



T N 



N 



A N + b 2 N \ T R T N + b%Y, hMU^t) 



t=Q 



(At-1, VT-l(^0:T-2,Pr-l) ' At- 



(b) 



lim sup 



{T-1 
b 2 N \ T R T N + b 2 N Y, hM^t) 
t=o 

(At-1, Vt-i("0O:T-2,PT-i) • At-i) 



1 



(c) 



(d) 



lim sup 

N— >oo 



0. 



1 



log E T exp { 6^ ( At- i , 1 : T- 2 , Pt- i ) ) } 

TV 

(At-i, Vt-i(^o:T-2)Pt-i) • At-i 



where (a) comes from (3.4), (b) comes from the exponential equivalence, 
(c) follows from the definition of pt-1 (see Remark 3.3) and (d) follows from 
the induction assumption. Therefore, (3.3) is proved and so is Theorem 3.1. 

□ 



4. Extensions of the MDP. In this section we extend the MDP to un- 
bounded functions and we derive a functional MDP. 



4.1. The MDP for unbounded functions. In this section we extend the 
MDP to unbounded functions. The main argument in the following proof is 
the use of a concentration property for i.i.d. random variables established by 
Ledoux [20]. For the sake of simplicity, we establish the MDP for MJ^^t) 
instead of M^(-(/>0: t)- However, the same kind of results holds for M^-( , 0o:t)- 

Let T > 1 and assume the following stronger version of Assumption A-0: 
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Assumption A- 1 . There exists a nonnegative constant C a such that 
for every t > 1 , there exist functions hf , h~[ for which 

C~ l hj (V) < a t (x, x) < C a ht(x') V (x, x') GR^xl, 

Moreover, 

0<Q 1 / ht(x')b t (x')dfi{x') < C a f ht (x')bt(x') dfi(x') <oo VyGlR" 1 . 



Remark 4.1. It is straightforward to check that Assumption A-l yields 
Assumption A-0. Recall that at and bt are defined in (1.3) and (1.4), then 
Assumption A-l implies that 

< C- 1 J hth dn < b t (x t -i) <C a J h+b t dfi, 

< ^ 2 ™^ < at(xt^xt) < Cg ^ffy . 
J fit bt d/i J h t bt dji 

Otherwise stated, the particle model coincides with a simple genetic model 
with strongly mixing df-mutations and regular o^-selections. 

Assumption A-l enables us to introduce the following class of functions: 

£ T = jV]R d ^]R; 3(3 >0, J^e^ {x) \ h+ {x)b T (x,y)iJL{dx) < oo^, 

S T =^:M. d ^R; V/3>0, J ^ e^ x ^" /(1+2a) h+(x)b T (x) fi(da) < oo}. 

In the case where < a < ^, one can readily check that < < 1 and 
£ T becomes a set of functions with subexponential moments. 

Theorem 4.1. Assume that Assumption A-l holds. 

1. In £ae case where ipx G ^T; t/ien Vt(Vt) ^ s finite for every T > 1 and 
MJj{iJ)t) satisfies the MDP with good rate function It- 

2. Ze£ < a < 1/2 and /12; &at = A a . /n £ne case where ipT G £t> 
Vt(V't) ,/miie /or ewer?/ T > 1 and M^(?/V) satisfies the MDP with 
good rate function It . 

Remark 4.2. In the case where T = 0, the problem reduces to the MDP 
for i.i.d. random variables and is well known (see, e.g., [3, 20]). 

Proof of Theorem 4.1. Since /t\t{x) < ^l~J^^J~ b y Assump- 
tion A-l, there exists (3 > such that 

J efl*H f* Tdfi < oo ( resp . V/3 > 0, Je^ a/(1+2a) f» ]T dv < oo 
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whenever ipx £ £t (resp. tpT G &t)- Therefore, tut^t) = / ^t/t|t^M an d 
/ V't/tit^M are finite. In particular, cr^ipr) < oo. Similarly, 



|L T ^ T (x) 



ip T aT(x,-)bT(-,y)dn 



<C a \ip T \h^bT(-,y)dn<oo, 



by Assumption A-l and the function LtiPt(-) is bounded. So is LtiPt(-) — 
tot^t^tIK - )- Finally, Vt-^Lt^t ~ "?-t(V ; t)-^t1) < oo by Theorem 3.1 
and Vt(iPt) is finite by (2.7). Define 

#0*0 = V>t(z)1 |V>t(z)|<c and #( x ) = VT(x) - 

By Theorem 3.1, Mj^(ipj,) satisfies the MDP with good rate function It, c { x ) = 
x 2 /Vt(ipj^). Let us now prove that 

(4.1) V<5>0 lim lim T2 -logP T (|Af^(#)|>5) = -oo. 

Condition (4.1) is sufficient to get an MDP for MJ^(tPt) since it asserts 
that (M^(</^)) oo is an exponential approximation of MJj^t)- Recall that 
.Mjy = + Rjj [see (2.4)]. Therefore, in order to prove (4.1), it is sufficient 
to prove that 

(4.2) V<5>0 lim lim -J- IogP T (|i$(#)| > <5) = -oo, 

c->ooJV— ioo Ojy 

L logPT(|(? T 

Let us first prove (4.2). As in Theorem 3.1, we first prove that Rjjfyj,) and 
^jv(^t) are exponentially equivalent. This result is not a direct consequence 
of Lemma 3.2 since ipj- is not bounded. However, since t/'t £ ( res P- £ t) 
implies that Lt^t ~ wHV^)^-"- * s bounded, one can prove the exponential 
equivalence as in the proof of Lemma 3.2. Now, since lim^oo Vt-i^tV't — 
mr(V'y)LTlL) = 0, one has 

lim limsup ^ log Pt{ 1^(^)1 > = -co, 
c^oo jy^oo b N 

and (4.2) is proved by the exponential equivalence. 
Let us now prove (4.3). 
In the case where V'T £ £t , denote by 

A c 2 J\$t\ 2 h T h Tdn 

J bx djji 

Then < a 2 N t (4>t) — P( c ) which is deterministic and satisfies lim^oo /3(c) = 
0. 



(4.3) V5>0 lim lim logP T (| QmY>t)| > $) = -oo. 

c— >oo.2V— >oo \f 
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Since the (xy)'s are i.i.d. with law f^\ T conditionally on J 7 ^ -1 , the large 
deviation upper bound for i.i.d. random variables yields 



N 



ojvv jV i=1 



>5\T T N ~ 1 



N 



1=1 



> 



T-l 



V 



where the former inequality is valid for every N > 1 (see [14], Chapter 2) 
and A* N is given by 



A* N ( X ) =sup|Ax-ln J e x ^T- m T^T»fK T dti 



sup < Xx — In 1 + 



+ Efe[/(#-<(#)) fc /^T^ 



fc=3 



Since — ln(l + u) > — u for u > — 1, one gets 

h-N\ x ) — SU P 1 * x o 



E^f / (l#l + K(#)l) fc /^4 



Let x = S«£ and choose A = -M-r 

VN VN/3(c) 



A 



N 



b N 5\ 



> 



, then 



\b N 5\* 



■° V- 

2NP(c) Jh^b T dn^ 3 \^Np( c )\ k k\ 



(\iPt\ + ™t(#)) rhtbrdfi, 



where my(^y) = ^a^~j^=Y^~ ■ I n particular, 



A 



N 



b N 5 



2 x2 



> 



¥ N 5 



Nj ~ 2Nf3(c) 2N 



T(c,N), 
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where T(c,N) is deterministic and linijv-»oo r(c, N) = 0. Thus, 



1 



N 



J2 



> 5 > < 2 exp 



ft 2 A 2 7> 2 

.M, ^r( c ,iv) 

2/3(c) 2 ^ ; 



and (4.3) is proved in the case where ip? G St since lim c ^ 00 /3(c) = 0. 
In the case where tpx £ £ t-> denote by 



& = ■0rl{|^c|<^n/& JV } and 2 = 



Then 



(4.4) 



)) 



>5 



m^((/>i)) 



5 

>2 



+ : 



V 



£>2-m£(02)) 



5 

>2 



One can deal with the first part of the right-hand side of the inequality 
as done previously in order to obtain 



(4.5) 



1 



v 



< 2 exp 



> 



. « + lr(c iv) 

20(c) + 2 1 ' J 



with lini7v-»oo T(c, N) = 0. 

Let us now deal with the second part of the right-hand side of (4.4). Since 
4>2 G £j> an d bjy = N a , one can prove (cf. [2]) that there exists M > such 
that 

(4.6) rrmsup^logiVP(|^ 2 (5f)-E(0 2 )|>uV / iV : 6iv)<-^, 

JV->oo Oat M 



where F(dx) = h r^ x ) l >T{x)^{dx) . g distributed according to P. Denote 

J hj.br d/i 1 
by^ = Q 2 (SS-Onegets 



J h T bT dfi 



(4.7) 



2 (xf)-m^(^ 2 )|>n6 JV ViV|^- 1 } 
< P{|<^ 2 (xf ) - E(<fo)\ > 2~ 1 ub N ^N\^ 1 } 
+ F{\m$(<h) ~ E(0 2 )| > 2" 1 n6^^|^- 1 }. 
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Since m^d^l) < kE|</>2|, there exists Nq deterministic such that 

F{\rr4(<h) - E((j) 2 )\ > 2~ 1 ub N VN\^- 1 } = for N > N . 
Therefore, there exists Ni deterministic and M 2 > such that 



iVP{|</> 2 (< ) -m£((fc)| > u&WATO } 

(48) / uW\ 

<Kexpf — j^-j {or N>N V 

With condition (4.8) in hand, a minor modification of the proof of Theorem 1 
in [20] yields 

N 



(4.9)V<5>0 limsup-^-log 

N— >oo b N 



:£(&-m£(&)) 



>^ U-OO. 



Finally, (4.5) and (4.9) yield (4.3) in the case where ip G 

It remains to identify the rate function. In fact, the exponential approxi- 
mation procedure yields to the formula 

I(x) = supliminf inf It c (z)- 

e>0 c ^°° \z-x\<e ' 

It is straightforward to check that Vt("0t) ~~ > Vt^t) as c — > 00 by the 
dominated convergence theorem. Since It,c(x) = x 2 /Vt{^j)^ we easily get 
I{x) = x 2 /VtOjt), which concludes the proof. □ 

4.2. A functional MDP. We now state a functional version of the MDP. 
Consider the space of cadlag functions D = D([0, 1],R) and let M% T : [0, 1] -> 
D be defined by 

ro, if < « < 1/AT, 

N ' T I y= ^ (ip(xi t T) — "1t(V0)' otherwise, 

where [a] denotes the integer part of a. We shall establish the MDP for 
Mjy t G D. For the sake of simplicity, we only consider the particle profile 
involving the last generation of particles and we assume ifj to be bounded. 
We will denote by ACo the set of absolutely continuous functions / from 
[0, 1] to R with /(0) = [in particular, / G AC f(v) =' /„" f(u) du with 
feL\du)}. 

Theorem 4.2. Assume that Assumption A-0 holds and endow D with 
the supremum norm topology. Then the functional 

Mf)=\J 2o^) dt+ —\vm~vm)' lffeACo > 

I +00, otherwise, 
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is a convex good rate function and Mjy T satisfies the MDP in D with rate 
function Jt- 

Remark 4.3. Note that the contraction principle yields immediately 
Theorem 3.1. The unusual form of the rate function Jj- (from the point of 
view of Theorem 3.1) might be interpreted as the centering with the true 
filter density and the particles dependency with the last generation. 

Proof of Theorem 4.2 is postponed to Appendix B. 

5. Examples. 

A nonlinear observation model with additive noise. Let {(Xt,Yt);t > 0} 
be a family of random variables recursively defined by 



where /jilxl-tl (resp. gt :R — ► R) is a i3(R x Immeasurable [resp. 
,B(R)-measurable] function and (et)t>o [resp. (rjt)t>o] is a family of i.i.d. 
random variables. 

Proposition 5.1. Assume that rjt has a bounded and positive density 
with respect to the Lebesgue measure, then Assumption A-0 holds. 

Proof. Let b be the density of r\ t w.r.t. the Lebesgue measure. Using 
that bt(u,y) = b(y — gt(u)), we have 



Moreover, for all x £R, L t t(x) = f a t (x,u)b(y — g t (u))n(du) > since b(v) > 
for all v € R. The proof is complete. □ 

A stochastic volatility model. Let {(Xt, Yj); t > 0} be a family of random 
variables recursively defined by 



where / 4 :R^R is a £>(R)-measurable function and (et)t>o [resp. (i] t )] is a 
family of i.i.d. random variables. We refer to [22] for more references and 
results on this model. 



Xt+i — ft(X t ,e t ), 
Y t =g t (X t )+r ]t 




sup6(t>) < oo. 



v 



Xt+i — ft{X t ,e t ), 
Y t = exp(X t )r]t 



PROPOSITION 5.2. Assume that r] t ~ jV(0, 1), then Assumption A-0 holds. 



20 R. DOUC, A. GUILLIN AND J. NAJIM 

Proof. Following the arguments used in the proof of Proposition 5.1, it 
is sufficient to prove that for all y, sup x \bt(x,y)\ < oo. This can be achieved 

by noting that, since b t {x,y) = ^^ x) ex P(- 2ex p(2x) )' we have for a11 V> 
lim^oo b t (x,y) = lirn^-oo h{x,y) = 0. □ 

Remark 5.1. In this example, Assumption A-0 holds and one has Vy 6 
R m , M x b t (x,y)=0. 

An example of unbounded functions. Consider the previous framework, 
slightly modified: 

X t+1 = f t (X t ) + e t , 
Y t = g t {X t ) + ri t , 

in the particular case where ft and gt are bounded continuous and at = 1. 
Assume, moreover, that e-t ~ A/"(0, 1) and that r]t has a positive continu- 
ous density ut(z) with respect to the Lebesgue measure. In this case, the 
probability kernels are given by 

f If (xt-ft^(xt^)) 2 

a t {xt-i,xt) = —=exp' 

V Z7T 



bt(x t ,yt) =u t {y t - gt(xt)), 

and Assumption A-l is trivially satisfied. In particular, bt{x,y) is bounded 
for fixed y uniformly in x. Moreover, one can choose hf as 

hf{x) = C t e^ 2 > 2+Mt \ x \ 

where Ct,Mt > are constants depending on ft. In this case, 

'^:lR^]R;3/3>0, / e l3\^)\ e -W^ 2 +M t \x\ dx < 1 



S f = U ;R - R; V/3 > 0, J S^ 4ani+2a) e-V 2 ^ 2+M *W dx < oo 

In particular, 

{^:R^R;3A">0, |V>0)| < K(l + x 2 )} C £ t and 

tp:x^ log + (|x|) G £f 

Moreover, 

: K -> K; 3 if > 0, 3 G (0, 1), < + x «( 1 + 2 ")/(2a))} c ^ 

and one gets interesting examples based on unbounded functions for which 
the MDP holds. 
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Proof of Lemma 3.2. Let Km be defined by 



1 



N 



K N = — (L T ip T (x it T-i) - m T (tp T )L T t(x i:T ^i)). 



i=i 



NK N f 



We can express the difference as 



I r>T ST i 
\ n N ~ n N\ 



Thus, 

V T {\R%-R%\>S} 
(A.l 



<Pt{|^|>^} + F t { 



> 



L 



Since rriT-i(LTipT ~ 'TCtCV't^tI) = 0, one can apply Lemma 2.1 to the fist 
part of the right-hand side, 



limsup-J-logP r (|KAr| > 



LV6b 



N 



< 



L 2 5 



Let us now deal with the second part of the right-hand side of (A.l) 

N \ -1 



N 



J2LTt(Xi,T-l)) -k~\T) 



8=1 



^ 2 T \m\io(5(T) l- 

dit-1 



-oo. 



> 



L 



1 



1 N 

— 2J L T t(x it T-l) - KT 
i=l 



-J^yj^l^ L TMxi,T-l) -K T J> —Kt 



kt L 



N 



Jf ^Tl(^i,T-l) - K T 



i=l 



V6 

>—K T . 



Denote by e(L) = ^ k t(^t + -77 ) 1 and apply Lemma 2.1 to conclude 



1 j_y^H 
L 

N 



lim sup - j- log I 

AT— >oo N 



— ^ L N l(x i)T -l) - K T 



i=l 



>e(L) 



-00 



for every L > 0. Therefore, Lemma 3.2 is proved. □ 
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Proof of Theorem 4.2. In order to prove the functional MDP, one 
may want to follow the lines of proof of Theorem 5.1.2 in [14] and to intro- 
duce the polygonal approximation Mfj T of M^ T . However, it turns out to 

be nontrivial to prove the exponential tightness of M"^ T in C[0, 1] for the 
sup-norm. In particular, the level sets are useless since one can show that 
lnnj V - >00 P(A^ r i {J< a}) = 1. This issue is circumvented with the use of 
the following lemma whose proof can be found in [16], Lemma A.l. Denote 
by U the set of all subdivisions of [0, 1], that is, 

u eu u = {o = uq < ui < ■ ■ ■ < u m < i}. 

Lemma B.l. Let (Xn(u); < u < 1)at>o be a sequence of cadlag pro- 
cesses defined on (Q,F,¥). Endow the space D with the uniform convergence 
topology and let (\(N))n>q be a sequence of positive numbers going to in- 
finity. Assume that: 

(i) For every U = {0 = n < ui < • • • < u m < 1} G U, (X N (m), . . .,X N (u m )) 
satisfies the LDP on R m with speed \(N) and rate function L u . 

(ii) For every 5 > 0, 

lim sup lim sup — — - log P ( sup \Xn(v) — Xn(u)\> 5\ = —oo 

£ ^°0<n<l TV^oo A (AT J \ii<«<u+£ / 

[convention: Vu> 1, Xjy(u) = Xn(1)]. 

Then (Xjv) satisfies the LDP in ID with speed X(N) and rate function given 
by 

1(f) = sup I U ((f( Ul ), . . . , f(u m ))), f e ID). 

Moreover, the set {I < +00} is a subset of the space C[0, 1] of continuous 
functions over [0, 1] . 

As in Theorem 3.1, we will proceed by induction. Since the function ip 
is bounded and the first generation of particle is an i.i.d. sample from ao, 
Mogulskii's theorem yields the functional MDP at time T = 0. 

Step 1. The finite- dimensional MDP. Recall that 

[Nu] 

b N VN i=1 

1 [iV ^ [Nu] 



b N VN ^ ' ' b N VN 
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and let U = {0 = uq < U\ < • • • < u m < 1} eW. We shall first prove that the 
vector (M^ T (iij))i<j< m satisfies the MDP. Since the map 

(x\ , . . . , X rn ) I ► (x\, %2 X\ , . . . , X m X m —\) 

is continuous and one-to-one, it is sufficient by the contraction principle to 
prove the MDP for 

Moreover, using the exponential equivalence proved in Lemma 3.2, one only 
has to prove the MDP for the family (Mfj T (ui) — M^ T (uj_i))i<j< m , where 



[Nu] 



M 



+ 



u 



Nb N K% 



I N N 
\i=l i=l 



Q T N {u)+R T N {u). 

By the same arguments as in the proof of Theorem 3.1 (conditioning with 
respect to Tj{ to deal with Qjj, using the induction assumption to deal with 
Rjj), one can show that the limit 

A(Ai,...,A m ) = lim -g-logErexp ( b%Y]\i(MN,T{ui) - Mn,t(ih-i)) 



i=l 



is equal to 



At(Ai, . . . , A m ) = - - u;_i)Afor(V0 



i=l 



+ 



^ Xi(ui - Ui-i) 



.i=i 

Consequently, the MDP is proved for (M^ T (ui) — M% T (ui-i))\<i< m by 
Gartner-Ellis' theorem and one can identify the rate function as 



Jt( x 1j • • • > x rn) — E 



+ 



2af,(V0W)«a 



i=l 
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Thus, the MDP holds for (M^ T (uj))i<i< m with good rate function 



Jrp (X\, ■ ■ ■ , X m ) ^ ' 



Vt-ALt^t ~ m T (ip)L T t) ^ 2 



E 



+ 



/ 1 



Step 2. T/ie negligibility with respect to the sup-norm. Let us prove now 
that V<5 > 0, 



N 



lim sup lim sup log ( sup \M^ T (v) — M^ T (u)\ > 6 

£ ^°0<m<1 n->oo b h 



u<v<u+e 



-OO. 



By Lemma 3.2, it is sufficient to prove that V<5 > 0, 

lim sup lim sup -j- log Ft ( sup \Qjj(v) — Q%(u)\ > 5 



11111 UU^I 11111 U Ll^/ cy 

£ ^°0<u<l 7V->oo 0, 



u<v<u+e 



-OO, 



0<u<l iV^oo b 2 N 



lim sup lim sup log sup \R N (v) — R N (u)\ > 5 = — oo. 



u<v<u+e 



Note that the last limit is directly obtained by the induction assumption. 
Thus, we only have to establish the first one, 



F T ( sup \Ql(v)-Q%( U )\>6) 

\U<V<U+£ / 



sup 

u<v<u+e 



[Nv] 



i=l 



[Nu] 



(B.1) 



i=l 



(Pt( sup 



i=[Nu]+l 



yVNj 



< E T P r max 

V V l<fc<[iVe]+l 



i=l 



> 5b N VN\Fl~ l 



where the last inequality follows from the fact that [Nv] — [Nu] < [Ne] + 1 



and by the stationarity conditionally on JF^ 1 . By Ottaviani's inequality 
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(see [21], Chapter 6, Lemma 6.2), 



Py max 
\ l<k<[Ne]+l 



i=l 



(B.2) <P T | 



[JVe]+l 

(VK^.t) -m NjT (i>)) 

i=i 



>Sb N VN)\J'Jf 1 



-T-l 

N 



> 5b N VN/2\F 



x < 1 — max Ft 

l<k<[Ne] 1 



[iVe]+l 

X (^(xi,T) - m N ,T(il>)) 

i=k+l 



> Sb N 



Let us first control the lower part of (B.2): 
V i=k+i 



[JVe]+l 
i=k+l 



>5b N y/N/2\^~ 1 



<4 



([JVeJ-fc + l)^]. 



fc+l,T 



^ 16 Sr — » °- 

ubjy 7V->oo 



In particular, there exists a deterministic Nq such that for every N > JVq 



max Py I 
l<fe<[JVe] 



[AT E ]+1 
i=k+l 



> 5b N y/N : /2\F%- 1>S J < 1/2. 



Inequality (B.l) together with (B.2) yields 
F T ( sup \Q T N {v)-Q T N (u)\>5 

\u<v<u+e 



< 2P T 



( 1 



\b N VN 



[Ne]+1 
i=l 



> 
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Now, 
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1 



b N VN 
<Pr( 



[Ne]+1 
i=l 



> 



1 



And 



1 



lim sup rpr log Pr 



+ Pt 



1 



[Ne 



[Ne}+1 

t=i 



> 



,mr(^) -mjv |T (^)| > ^ 



1 



[ATe]+l 
i=l 



>- 



< sup lim sup 75- log ] 



1 



[ATe]+l 
i=l 



>- 



1 



I / A / ,M 5 

=— |mrW - m N ,TW\ > 



lim sup -j- log P 

n— >oo O^y 

By the first step of the proof (finite dimensional MDP), 

[Ns]+1 



1 . / 1 

lim sup 75- log Pr 



i=l 



< 



+ 



/ 1 



1 y*/4) s 



16ecr t 2 (V>) \Vr(V0 2 



> 



-00. 



By Lemma 3.2, -^^-(rnr(ip) — rriN ,t(V0) and R%(e) are exponentially equiv- 
alent up to the speed b 2 N . Thus, 



lim sup -5- log I 

n—>oo O^y 



=j-\m T W - mN,TW)\ > ^ 



lim sup -2- log P T I ^(e) I > - 



< 



-OO. 



16e 2 V T -i(L T (ij) - mrWO-M 1 )) e->o 
This yields the desired result: 

lim sup lim sup log Py ( sup \Qn(v ) — Q%(u)\ > 5j = — 00. 

£ ^°°0<ii<l n->oo Ojy \«<ij<ii+e / 
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Step 3. The MDP. By Steps 1 and 2, the assumptions of Lemma B.l 
are satisfied. Therefore, t satisfies the MDP in D endowed with the sup- 
norm topology with speed b 2 N and good rate function 

J(/) = sup 4{f{u x ),..., f(u m )). 
v&u 

Step 4. Identification of the rate function. The identification of the rate 
function is fairly standard and can be done as in the proof of Lemma 5.1.6 
in [14]: 

J(/)=supJ^(/(m),...,/(n m )) 

u 

1 ' 2 « *+' 2 W 1 



o 24W,) 2 VVtM 4W 

The convexity of Jf is now straightforward. This ends the proof of Theorem 
4.2. 



□ 
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